Increasing uptake through collaboration in the development of core outcome sets: Lessons learned at OMERACT 2023.

OBJECTIVE: This manuscript highlights the importance of enhancing the uptake of Core Outcome Sets (COS) by building partnerships with Collaborators and addressing their needs in COS development. METHODS AND SETTING: This session was structured as a simulation, resembling a format akin to a classic television game show. The moderator posed a series of questions to eight different Collaborator groups who briefly described the importance of COS within their areas of interest. Previous studies examining the uptake of individual core outcomes revealed disparities in uptake rates. The Identified barriers to the uptake of COS include the lack of recommendations for validated instruments for each domain, insufficient involvement of patients and key Collaborator groups in COS development, and a lack of awareness regarding the existence of COS. CONCLUSIONS: This analysis underscores the need for COS development approaches that prioritize the inclusion of patients and diverse Collaborator groups at every stage. While current studies on COS uptake are limited, future research should explore the broader implementation of COS across diverse disease categories and delve into the factors that hinder or facilitate their uptake such as, the importance of COS developers extending their work to recommending domains with well validated instruments. Embracing patient leadership and multifaceted engagement is essential for advancing the relevance and impact of COS in clinical research.

Real-world evidence for coverage determination of treatments for rare diseases.

Health technology assessment (HTA) decisions for pharmaceuticals are complex and evolving. New rare disease treatments are often approved more quickly through accelerated approval schemes, creating more uncertainties about clinical evidence and budget impact at the time of market entry. The use of real-world evidence (RWE), including early coverage with evidence development, has been suggested as a means to support HTA decisions for rare disease treatments. However, the collection and use of RWE poses substantial challenges. These challenges are compounded when considered in the context of treatments for rare diseases. In this paper, we describe the methodological challenges to developing and using prospective and retrospective RWE for HTA decisions, for rare diseases in particular. We focus attention on key elements of study design and analyses, including patient selection and recruitment, appropriate adjustment for confounding and other sources of bias, outcome selection, and data quality monitoring. We conclude by offering suggestions to help address some of the most vexing challenges. The role of RWE in coverage and pricing determination will grow. It is, therefore, necessary for researchers, manufacturers, HTA agencies, and payers to ensure that rigorous and appropriate scientific principles are followed when using RWE as part of decision-making.

Early technology review: towards an expedited pathway.

OBJECTIVES: Evidence development for medical devices is often focused on satisfying regulatory requirements with the result that health professional and payer expectations may not be met, despite considerable investment in clinical trials. Early engagement with payers and health professionals could allow companies to understand these expectations and reflect them in clinical study design, increasing chances of positive coverage determination and adoption into clinical practice. METHODS: An example of early engagement through the EXCITE International model using an early technology review (ETR) is described which includes engagement with payers and health professionals to better inform companies to develop data that meet their expectations. ETR is based on an early evidence review, a framework of expectations that guides the process and identified gaps in evidence. The first fourteen ETRs were reviewed for examples of advice to companies that provided additional information from payers and health professionals that was thought likely to impact on downstream outcomes or strategic direction. Given that limitations were imposed by confidentiality, examples were genericized. RESULTS: Advice through early engagement can inform evidence development that coincides with expectations of payers and health professionals through a structured, objective, evidence-based approach. This could reduce the risk of business-related adverse outcomes such as failure to secure a positive coverage determination and/or acceptance by expert health professionals. CONCLUSIONS: Early engagement with key stakeholders exemplified by the ETR approach offers an alternative to the current approach of focusing on regulatory expectations. This could reduce the time to reimbursement and clinical adoption and benefit patient outcomes and/or health system efficiencies.

A practical approach for adoption of a hub and spoke model for cell and gene therapies in low- and middle-income countries: framework and case studies.

In the rapidly evolving landscape of biotechnologies, cell and gene therapies are being developed and adopted at an unprecedented pace. However, their access and adoption remain limited, particularly in low- and middle-income countries (LMICs). This study aims to address this critical gap by exploring the potential of applying a hub and spoke model for cell and gene therapy delivery in LMICs. We establish the identity and roles of relevant stakeholders, propose a hub and spoke model for cell and gene therapy delivery, and simulate its application in Brazil and the Middle East and North Africa. The development and simulation of this model were informed by a comprehensive review of academic articles, grey literature, relevant websites, and publicly available data sets. The proposed hub and spoke model is expected to expand availability of and access to cell and gene therapy in LMICs and presents a comprehensive framework for the roles of core stakeholders, laying the groundwork for more equitable access to these lifesaving therapies. More research is needed to explore the practical adoption and implications of this model.

Improving Food and Drug Administration-Centers for Medicare and Medicaid Services Coordination for Drugs Granted Accelerated Approval.

Policy Points The increasing number of drugs granted accelerated approval by the Food and Drug Administration (FDA) has challenged the Medicare program, which often pays for expensive therapies despite substantial uncertainty about benefits and risks to Medicare beneficiaries. We recommend several administrative and legislative approaches for improving FDA-Centers for Medicare and Medicaid Services (CMS) coordination around accelerated-approval drugs, including promoting earlier discussions among the FDA, the CMS, and drug companies; strengthening Medicare's coverage with evidence development program; linking Medicare payment to evidence generation milestones; and ensuring that the CMS has adequate staffing and resources to evaluate new therapies. These activities can help improve the integrity; transparency; and efficiency of approval, coverage, and payment processes for drugs granted accelerated approval. CONTEXT: The Food and Drug Administration (FDA)'s accelerated-approval pathway expedites patient access to promising treatments. However, increasing use of this pathway has challenged the Medicare program, which often pays for expensive therapies despite substantial uncertainty about benefits and risks to Medicare beneficiaries. We examined approaches to improve coordination between the FDA and Centers for Medicare and Medicaid Services (CMS) for drugs granted accelerated approval. METHODS: We argue that policymakers have focused on expedited pathways at the FDA without sufficient attention to complementary policies at the CMS. Although differences between the FDA and CMS decisions are to be expected given the agencies' different missions and statutory obligations, procedural improvements can ensure that Medicare beneficiaries have timely access to novel therapies that are likely to improve health outcomes. To inform policy options and recommendations, we conducted semistructured interviews with stakeholders to capture diverse perspectives on the topic. FINDINGS: We recommend ten areas for consideration: clarifying the FDA's evidentiary standards; strengthening FDA authorities; promoting earlier discussions among the FDA, the CMS, and drug companies; improving Medicare's coverage with evidence development program; tying Medicare payment for accelerated-approval drugs to evidence generation milestones; issuing CMS guidance on real-world evidence; clarifying Medicare's "reasonable and necessary" criteria; adopting lessons from international regulatory-reimbursement harmonization efforts; ensuring that the CMS has adequate staffing and expertise; and emphasizing equity. CONCLUSIONS: Better coordination between the FDA and CMS could improve the transparency and predictability of drug approval and coverage around accelerated-approval drugs, with important implications for patient outcomes, health spending, and evidence generation processes. Improved coordination will require reforms at both the FDA and CMS, with special attention to honoring the agencies' distinct authorities. It will require administrative and legislative actions, new resources, and strong leadership at both agencies.

What, Where, and How to Collect Real-World Data and Generate Real-World Evidence to Support Drug Reimbursement Decision-Making in Asia: A reflection Into the Past and A Way Forward.

BACKGROUND: Globally, there is increasing interest in the use of real-world data (RWD) and real-world evidence (RWE) to inform health technology assessment (HTA) and reimbursement decision-making. Using current practices and case studies shared by eleven health systems in Asia, a non-binding guidance that seeks to align practices for generating and using RWD/RWE for decision-making in Asia was developed by the REAL World Data In ASia for HEalth Technology Assessment in Reimbursement (REALISE) Working Group, addressing a current gap and needs among HTA users and generators. METHODS: The guidance document was developed over two face-to-face workshops, in addition to an online survey, a face-to-face interview and pragmatic search of literature. The specific focus was on what, where and how to collect RWD/ RWE. RESULTS: All 11 REALISE member jurisdictions participated in the online survey and the first in-person workshop, 10 participated in the second in-person workshop, and 8 participated in the in-depth face-to-face interviews. The guidance document was iteratively reviewed by all working group members and the International Advisory Panel. There was substantial variation in: (a) sources and types of RWD being used in HTA, and (b) the relative importance and prioritization of RWE being used for policy-making. A list of national-level databases and other sources of RWD available in each country was compiled. A list of useful guidance on data collection, quality assurance and study design were also compiled. CONCLUSION: The REALISE guidance document serves to align the collection of better quality RWD and generation of reliable RWE to ultimately inform HTA in Asia.

Uncertainty management in regulatory and health technology assessment decision-making on drugs: guidance of the HTAi-DIA Working Group.

OBJECTIVES: Uncertainty is a fundamental component of decision making regarding access to and pricing and reimbursement of drugs. The context-specific interpretation and mitigation of uncertainty remain major challenges for decision makers. Following the 2021 HTAi Global Policy Forum, a cross-sectoral, interdisciplinary HTAi-DIA Working Group (WG) was initiated to develop guidance to support stakeholder deliberation on the systematic identification and mitigation of uncertainties in the regulatory-HTA interface. METHODS: Six online discussions among WG members (Dec 2021-Sep 2022) who examined the output of a scoping review, two literature-based case studies and a survey; application of the initial guidance to a real-world case study; and two international conference panel discussions. RESULTS: The WG identified key concepts, clustered into twelve building blocks that were collectively perceived to define uncertainty: "unavailable," "inaccurate," "conflicting," "not understandable," "random variation," "information," "prediction," "impact," "risk," "relevance," "context," and "judgment." These were converted into a checklist to explain and define whether any issue constitutes a decision-relevant uncertainty. A taxonomy of domains in which uncertainty may exist within the regulatory-HTA interface was developed to facilitate categorization. The real-world case study was used to demonstrate how the guidance may facilitate deliberation between stakeholders and where additional guidance development may be needed. CONCLUSIONS: The systematic approach taken for the identification of uncertainties in this guidance has the potential to facilitate understanding of uncertainty and its management across different stakeholders involved in drug development and evaluation. This can improve consistency and transparency throughout decision processes. To further support uncertainty management, linkage to suitable mitigation strategies is necessary.

Recommendations for economic evaluations of cell and gene therapies: a systematic literature review with critical appraisal.

OBJECTIVE: No consensus exists on the ideal methodology to evaluate the economic impact and value of new, potentially curative gene therapies. We aimed to identify and describe published methodologic recommendations for the economic evaluation of gene therapies and assess whether these recommendations have been applied in published evaluations. METHODS: This study was conducted in three stages: a systematic literature review of methodologic recommendations for economic evaluation of gene therapies; an assessment of the appropriateness of recommendations; and a review to assess the degree to which the recommendations were applied in published evaluations. RESULTS: A total of 2,888 references were screened, 83 articles were reviewed to assess eligibility, and 20 papers were included. Fifty recommendations were identified, and 21 reached consensus thresholds. Most evaluations were based on naive treatment comparisons and did not apply consensus recommendations. Innovative payment mechanisms for gene therapies were rarely considered. The only widely applied recommendations related to modeling choices and methods. CONCLUSIONS: Methodological recommendations for economic evaluations of gene therapies are generally not being followed. Assessing the applicability and impact of the recommendations from this study may facilitate the implementation of consensus recommendations in future evaluations.

Review finds core outcome set uptake in new studies and systematic reviews needs improvement.

OBJECTIVES: To review evidence about the uptake of core outcome sets (COS). A COS is an agreed standardized set of outcomes that should be measured and reported, as a minimum, in all clinical trials in a specific area of health or healthcare. STUDY DESIGN AND SETTING: This article provides an analysis of what is known about the uptake of COS in research. Similarities between COS and outcomes recommended by stakeholders in the evidence ecosystem is reviewed and actions taken by them to facilitate COS uptake described. RESULTS: COS uptake is low in most research areas. Common facilitators relate to trialist awareness and understanding. Common barriers were not including in the development process all specialties that might use the COS and the lack of recommendations for how to measure the outcomes. Increasingly, COS developers are considering strategies for promoting uptake earlier in the process, including actions beyond traditional dissemination approaches. An overlap between COS and outcomes in regulatory documents and health technology assessments is good. An increasing number and variety of organizations are recommending COS be considered. CONCLUSION: We suggest actions for various stakeholders for improving COS uptake. Research is needed to assess the impact of these actions to identify effective evidence-based strategies.

Variation in market access decisions for cell and gene therapies across the United States, Canada, and Europe.

Transformative cell and gene therapies have now launched worldwide, and many potentially curative cell and gene therapies are in development, offering the prospect of significant health gains for patients. Access to these therapies depend on decisions made by health technology assessment (HTA) and payer organizations. We sought to describe the emerging cell and gene therapies market access landscape by analyzing 17 US commercial payer medical policies, and HTA reports from five European countries and Canada. We found that some US health plans applied coverage restrictions more often than others (four plans applied restrictions in all decisions, while four plans applied restrictions in <30% of decisions). The European and Canadian HTA bodies recommend access to fewer therapies than US health plans, reflecting a more stringent approach in the context of limited evidence and high scientific uncertainty that is commonly associated with these treatments. Our findings suggest that patient access to approved cell and gene therapies is restricted in all regions studied, though the nature of these restrictions differs between US health plans and the European/Canada HTA recommendations. Payers, HTA groups, pharmaceutical companies, and other stakeholders should collaborate to more clearly define the "uncertainties" and develop market access policies that balance benefits of early access with ongoing data collection to close evidence gaps over time.

Proposed framework for patient-centered outcomes-based measures in alternative payment models.

OBJECTIVES: Alternative payment models (APMs) are part of a growing shift from volume-based, traditional fee-for-service payment models toward payment for value. To date, however, patients have been largely omitted from efforts to design new payment models. We sought to identify key characteristics of outcomes-based quality measures to inform future APMs that are more patient-centered. STUDY DESIGN: Using oncology as a learning case, we explored gaps in current APM quality measures, then engaged multiple stakeholders to identify and prioritize key characteristics of outcomes-based quality measures to guide future APM development. METHODS: We used a mixed-methods approach that consisted of (1) literature review, (2) key informant interviews, (3) stakeholder work group (involving group discussions and completion of an online prioritization survey), and (4) synthesis. RESULTS: Based on the lessons generated at each step of this exploratory project, we suggest a framework to guide deliberations among payers, providers, patients, and other APM stakeholders when selecting outcomes-based measures for future APMs or other value-based payment models. CONCLUSIONS: The proposed framework offers a stepping stone on the path to clinically meaningful, patient-centered, high-value care. Next steps may include a broader review of gaps in APM quality measures across multiple therapeutic areas, additional vetting from a more diverse group of stakeholders, or a formal consensus.

Real-world data for health technology assessment for reimbursement decisions in Asia: current landscape and a way forward.

There is growing interest globally in using real-world data (RWD) and real-world evidence (RWE) for health technology assessment (HTA). Optimal collection, analysis, and use of RWD/RWE to inform HTA requires a conceptual framework to standardize processes and ensure consistency. However, such framework is currently lacking in Asia, a region that is likely to benefit from RWD/RWE for at least two reasons. First, there is often limited Asian representation in clinical trials unless specifically conducted in Asian populations, and RWD may help to fill the evidence gap. Second, in a few Asian health systems, reimbursement decisions are not made at market entry; thus, allowing RWD/RWE to be collected to give more certainty about the effectiveness of technologies in the local setting and inform their appropriate use. Furthermore, an alignment of RWD/RWE policies across Asia would equip decision makers with context-relevant evidence, and improve timely patient access to new technologies. Using data collected from eleven health systems in Asia, this paper provides a review of the current landscape of RWD/RWE in Asia to inform HTA and explores a way forward to align policies within the region. This paper concludes with a proposal to establish an international collaboration among academics and HTA agencies in the region: the REAL World Data In ASia for HEalth Technology Assessment in Reimbursement (REALISE) working group, which seeks to develop a non-binding guidance document on the use of RWD/RWE to inform HTA for decision making in Asia.

Controversy and Debate Series on Core Outcome Sets. Paper 3: Debate on Paper 1 from the perspective of GRADE [Grading of Recommendations Assessment, Development and Evaluation].

BACKGROUND AND OBJECTIVES: Outcome measures can be defined as the quality and cost targets health care organizations are trying to improve. Health-related outcomes are used to assess the effect, both positive and negative, of an intervention or treatment. To be meaningful and relevant, outcomes should ideally focus on what matters to the population to whom an intervention is applied and who may experience the outcomes. In this commentary, with a GRADE perspective in mind, we will introduce a conceptual model to address the many health care stakeholders, for example, in health technology assessment (HTA), quality assurance, systematic reviews, guidelines, and coverage decisions, who are involved in making different types of health decisions based on the same health outcomes. We will also propose and describe a method of defining core outcomes that will support reconciliation as well as harmonization across these different fields. STUDY DESIGN AND SETTING: The main focus here is on outcomes that matter most to people including patients, family members, and caregivers. We describe the hub and spokes model for core outcome sets that allows for communication and integration across different disciplines and decision makers. Ideally, the core outcomes, also called main outcomes, would be identical across these fields, including, for instance, a systematic review, an HTA, and a clinical or public health guideline. We illustrate this challenge using examples. RESULTS: We present the hub and spokes model for direct core outcome sets and describe the challenge and solution in what we call the Standardized Outcomes Linking Across StakeholdeRs (SOLAR) system approach. Judgments will have to be made regarding how directly the outcome of interest for decision makers corresponds to the intended outcome and GRADE offers it through its indirectness domain. Health outcome descriptors (HODs) provide a solution to this. CONCLUSION: Relevant stakeholders should strive to harmonize outcome assessment for the different decision-making contexts and describe how the outcomes they use, optimally informed by systematic reviews of the importance of outcomes, relate to harmonized HODs. In the ideal world, decision makers would use the same harmonized HODs and transparently rate the degree of indirectness of the actual outcomes addressed.

Implementing health technology assessment in Ghana to support universal health coverage: building relationships that focus on people, policy, and process.

Ghana is one of the few African countries to enact legislation and earmark significant funding to establish universal health coverage (UHC) through the National Health Insurance Scheme, although donor funds have declined recently. Given a disproportionate level of spending on medicines, health technology assessment (HTA) can support resource allocation decisions in the face of highly constrained budgets, as commonly found in low-resource settings. The Ghanaian Ministry of Health, supported by the International Decision Support Initiative (iDSI), initiated a HTA study in 2016 to examine the cost-effectiveness of antihypertensive medicines. We aimed to summarize key insights from this work that highlights success factors beyond producing purely technical outputs. These include the need for capacity building, academic collaboration, and ongoing partnerships with a broad range of experts and stakeholders. By building on this HTA study, and with ongoing interactions with iDSI, HTAi, WHO, and others, Ghana will be well positioned to institutionalize HTA in resource allocation decisions and support progress toward UHC.

The Value of Diagnostic Information in Personalised Healthcare: A Comprehensive Concept to Facilitate Bringing This Technology into Healthcare Systems.

Health systems around the world seek to address patients' unmet health needs for a range of acute and chronic diseases. Simultaneously, governments strive to keep healthcare spending sustainable, while providing equal access to high-quality care. This has fuelled debate around what constitutes a valuable healthcare intervention in a health system and the corollary consideration of what governments are willing to pay for a certain health intervention. Until recently, the value of information in general, and the value of diagnostic information (VODI) specifically, was not part of the discussion.However, investment in diagnostic information can be a key development as information may guide more effective and efficient healthcare and help maintain an affordable health system. This paper therefore explores ways to best define, evaluate, and reward the value created from diagnostics in healthcare and how to include these value considerations in decision-making processes for diagnostics. The authors ultimately call for a holistic VODI framework that accounts for the full range of potential benefits of diagnostic testing, beyond the traditional clinical and health economic domains, and that is essential to recognise, measure, and fully leverage the benefits of diagnostics for patients, health systems, and society.

Analytic Considerations in Applying a General Economic Evaluation Reference Case to Gene Therapy.

The concept of a reference case, first proposed by the US Panel on Cost-Effectiveness in Health and Medicine, has been used to specify the required methodological features of economic evaluations of healthcare interventions. In the case of gene therapy, there is a difference of opinion on whether a specific methodological reference case is required. The aim of this article was to provide a more detailed analysis of the characteristics of gene therapy and the extent to which these characteristics warrant modifications to the methods suggested in general reference cases for economic evaluation. We argue that a completely new reference case is not required, but propose a tailored checklist that can be used by analysts and decision makers to determine which aspects of economic evaluation should be considered further, given the unique nature of gene therapy.

The increasing complexity of the core outcomes landscape.

In this project, we set out to identify ways to increase the uptake of core outcome sets in clinical research. In doing so, we uncovered a growing recognition, across many different health care sectors, of the need for common, relevant outcomes to improve the quality of decision-making. This has led to a plethora of projects, initiatives, and new organizations all intended to develop standardized outcomes and outcome measures for their particular fields. However, the standardized outcome sets developed across siloed initiatives do not carry over to other sectors, such as from research to quality of care. This trend has the potential to lead to confusion and unintended redundancies, as well as wasteful use of both financial and intellectual resources. Better communication and collaboration among different initiatives, and more deliberate alignments of initiative scopes, are needed to ensure a future paradigm in which standards align across contexts where possible and differ for understandable and transparent reasons.